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SUBSTITUTE SPECIFICATION 
Digital camera 

Field of the Invention 

[0001] The present invention relates to a digital camera, particularly 
but not exclusively to a digital camera included in a mobile communications 
device. 

Background Art 

[0002] Digital cameras are well known in the art. Increasingly, digital- 
cameras are being incorporated into other devices, such as mobile 
telephone handsets and an example is described in WO-A-131892. 




Summary of the Invention 

[0003] The present invention seeks to provide an improved digital 
camera. According to the present invention there is provided a digital 
camera including an image quality indicator. 

[0004] This has the advantage that the user is provided with feedback 
to indicate whether the camera is ready to take a picture and, if not, to allow 
the user to take appropriate measures. 

[0005] The digital camera may include a display for displaying an 
image together with image quality indicator. The image quality indicator 
may indicate whether an image is optimal based on one or more image 
parameters, including light exposure, white balance and/or dark reference. 
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[0006] The digital camera may be incorporated into a mobile 
communications device, such as a mobile telephone handset. 

[0007] According to the present invention there is also provided a 
method of operating a digital camera comprising providing a user interface 
of the camera with an image quality indicator. The method may comprise 
capturing an image and displaying the captured image, together with the 
indicator. 

[0008] This has the advantage that the user is provided with an 
objective indication of image quality. 

[0009] The method may further comprise executing one or more 
algorithms for determining the quality of the image, such as determining light 
exposure for the image, performing white balance of the image and/or 
determining a dark reference for the image. The method may comprise 
determining whether the one or more algorithms have found a stable 
solution. 

[0010] According to the present invention there is still further provided 
a computer program for performing the method. 

[0011] According to the present invention there is also provided a 
digital camera comprising an image sensor, a conversion circuit for receiving 
signals from the image sensor and producing an image signal, a display for 
receiving the image signal and outputting an image corresponding to the 
image signal and a control circuit for controlling the image sensor, the 
conversion circuit and the display, wherein the control circuit includes a 
processor configured to determine quality of the image signal and to 
produce a signal for indicating to a user whether the image signal satisfies 
one or more image quality conditions. 
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Brief Description of the Drawings 

[0012] An embodiment of the present invention will now be described, 
by way of example, with reference to the accompanying drawings in which: 

[0013] Fig. 1a shows the front of a mobile communications device; 

[0014] Fig. 1b shows the reverse a mobile communications device; 

[0015] Fig. 2 is a schematic diagram of mobile communications 
circuitry; 

[0016] Fig. 3 shows an LCD displaying an image captured by a digital 
camera with an indicator of image quality; 

[0017] Fig. 4 is a schematic diagram of a 3-bit register; 

[0018] Fig. 5 illustrates a process by which the quality of an image is 
determined and the indicator is displayed; 

[0019] Fig. 6 shows an image of optimal quality; 

[0020] Fig. 7 shows an image of near-optimal quality; 

[0021] Fig. 8 shows an image of poor quality; 

[0022] Fig. 9 shows an image of very poor quality; and 

[0023] Fig. 10 is a schematic diagram of an arrangement of a digital 
camera unit, a processor, memory and display. 
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Description of the Preferred Embodiment of the Invention 
[0024] Fig. 1a shows the front of a mobile communications device in 
the form of a mobile telephone handset 1, which is sometimes referred to as 
a cellular telephone handset. The handset 1 includes a microphone 2, 
keypad 3, liquid crystal display (LCD) 4 and speaker 5. The LCD 4 and 
speaker 5 form part of a user interface. 

[0025] Fig. 1b shows the reverse side of the handset 1 . The handset 1 
includes a detachable battery 6 for powering the handset 1 and a digital 
camera unit 7. The digital camera unit 7 is suitable for capturing still and 
moving images and comprises a lens, an image sensor, such as a 
complementary metal oxide semiconductor (CMOS) sensor and an 
analogue-to-digital (ADC) converter for supplying digital image data. 

[0026] Fig. 2 illustrates circuitry included in the handset 1. Signal 
processing is carried out under the control of a digital microcontroller 8 
which has an associated RAM/ROM 9 and flash memory 10. Electrical 
analog audio signals are produced by the microphone 2 and amplified by a 
pre-amplifier 1 1 . Similarly, analog audio signals are fed to the speaker 5 
through an amplifier 12. The microcontroller 8 receives instruction signals 
from the keypad 3 and controls operation of the LCD 4 and flash 
memory 10. 

[0027] Information concerning the identity of the user is held on a 
smart card 13 in the form of a GSM SIM card which contains the usual GSM 
international mobile subscriber identity and encryption K, that is used for 
encoding the radio transmission in a manner well known perse. The SIM 
card 13 is removably received in a SIM card reader 14. Radio signals are 
transmitted and received by means of the antenna 15 connected through a 
RF stage 16 to a codec 17 configured to process signals under the control of 
a microcontroller 8. 
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[0028] Image data captured by the digital camera unit 7 is processed 
by the microcontroller 8 and held in flash memory 10. The flash memory 10 
may be in the form of a removable "memory stick". The handset 1 may also 
be provided with a dedicated image processor (not shown) so as to reduce 
processing load on the microcontroller 8. Thus, the handset 1 may operate 
as a digital camera capable of capturing and storing still and/or moving 
pictures. 

[0029] An overview of digital cameras is given in "Complete Guide to 
Digital Cameras" by Michael Murie (Prompt Publications, 1999). 

[0030] Fig. 3 shows LCD 4 when the handset 1 is in a camera state, 
which is sometimes known as "camera mode". An image 18, in this example 
a picture of a boat, is captured by the camera unit 7 (Fig. 1) and is displayed 
by the microcontroller 8 in an image window 19. The image window 19 
includes an indicator 20 in the form of a three-level bar. The indicator 20 
specifies whether the handset 1 is able to capture an image of optimum 
quality in terms of exposure, white balance and dark reference. The 
image 18 is provided with a header 21 which allows the user to label the 
image 18. 

[0031] The image window 19 is used as a viewfinder to help the user 
to compose a picture. The user directs the camera unit 7 (Fig. 1 ) at a 
subject or scene, while the handset 1 automatically performs exposure 
control, adjusts white balance and determines dark reference using 
algorithms which are known per se. In this example, the microprocessor 8, 
in conjunction with the camera unit 7, executes the algorithms. 

[0032] An exposure control algorithm, which is often referred to as 
auto-exposure or simply "AE", is analogous to shutter speed control on a 
film camera, but in the case of a CMOS sensor it adjusts pixel integration 
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time and the various gain blocks in the system to satisfy the luminance of 
the scene and, if appropriate, to reject flicker due to lighting running off an 
alternating current source. 

[0033] A white balance algorithm, which is often referred to as auto- 
white balance or simply "AWB", attempts to adjust gains on the red, green 
and blue colour channels to correct imbalances caused by the spectral 
content of the scene illumination. 

[0034] A dark calibration algorithm attempts to subtract from a 
captured image the effects of dark current, which is the pixel leakage 
current. This quantity varies markedly with temperature. Information on the 
dark current is often derived from several rows or columns of pixels outside 
the usable image area which are masked to exclude ambient light. 

[0035] Generally, a stable solution to each algorithm is found by 
holding the handset 1 steady and allowing the handset 1 to try different 
conditions and settle on a set of solutions which represent an optimal image. 
However, the handset 1 will have difficulty determining the optimal image, if 
the subject or scene comprises for example moving objects or both high and 
low levels of lighting. 

[0036] According to the present invention, the user is provided with 
feedback to indicate whether the handset 1 is ready to take a picture, i.e. 
whether the algorithms have converged, and, if not, to allow the user to take 
appropriate measures, such as holding the handset 1 steady. 

[0037] Fig. 4 shows a control register 22 comprising first, second and 
third flags 23a, 23b, 23c which represent whether or not a stable solution of 
each algorithm has been found. In this case a flag set to "1" represents a 
stable solution. At one extreme, if all three flags 23a, 23b, 23c are set to 
"1", then the user is informed by shading all three levels 20^ 20 2 , 20 3 of the 
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indicator 20 (Figure 3). At the other extreme, if none of the flags 23a, 23b, 
23c are set, then none of the levels 20i, 20 2 , 20 3 are shaded. 

[0038] A process by which image quality is assessed and feedback 
provided will now be described: 

[0039] Referring to Fig. 5, an image is captured by the camera unit 7 
(Fig. 1) and displayed in the image window 19 (Fig. 3) (step S1). The 
microcontroller 8 executes the exposure control algorithm (step S2) and 
determines it has converged (step S3). If so, the first flag 23a is set to "1" 
indicating "stable" (step S4.1), otherwise, it is set to "0" indicating "not 
stable" (step S4.2). The microcontroller 8 runs a white balance algorithm 
(step S5)(step S6). If the algorithm converges, the second flag 23b is set to 
"1" indicating "stable" (step S7.1), otherwise, it is set to "0" indicating "not 
stable" (step S7.2). The microcontroller 8 runs a dark calibration algorithm 
(step S8) (step S9). If stable, the third flag 23c is set to "1" (step S10.1), 
otherwise, it is set to "0" (step S10.2). 

[0040] The microcontroller 8 then checks the state of the register 22. 

[0041] Initially, the microcontroller 8 checks whether the three 
flags 23a, 23b, 23c of the register 22 are set to "stable" (step S1 1 ). If so, all 
three stages 20i, 20 2 , 20 3 of the indicator 20 are shaded (step 12). Thus, 
the indicator appears as a fully-filled vertical bar. An example of an LCD 4 
showing an optimal-quality image 18, with all three stages 20i, 20 2 , 20 3 of 
the indicator 20 shaded, is shown in Fig. 6. 

[0042] If the first test fails, the microcontroller 8 checks whether any 
two of the flags 23a, 23b, 23c are set to "stable" (step S13). If two flags are 
set, then first and second levels 20i, 20 2 of the indicator 20 are shaded 
(step S14). Thus, the indicator 20 appears as a bar which is two-thirds 
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filled. An example of an LCD 4 showing a near-optimal quality image 18 is 
shown in Fig. 7. 

[0043] If the second test fails, the microcontroller 8 checks whether 
any one of the flags 23a, 23b, 23c is set to "stable" (step S1 5). If one of the 
flags 23a, 23b, 23c is set, then the first stage 20i of the indictor 20 is 
shaded (step S16). Thus, the indicator 20 appears as a bar which is only 
one-third filled. An example of an LCD 4 showing a poor quality image 18 is 
shown in Fig. 8. 

[0044] If all of the tests fail and none of the flags 23a, 23b, 23c are 
set, then no part of the indicator 20 is shaded (step S17), as shown in 
Fig. 9. 

[0045] The microcontroller 8 determines whether a key on the 
keypad 3 has been pressed (step S18). If a key has been pressed, then the 
image 18 is captured and stored in flash memory 10. Otherwise, the 
process returns to step S1. 

[0046] This process has the advantage that the user is provided with 
real-time feedback as to the quality of the image 1 8 being captured. If the 
image 18 is of poor quality, then further exposure control and/or white 
balancing and/or dark calibration is needed. This may be remedied by 
holding the camera steady for a period of time, such as a few seconds, or 
re-composing the picture. 

[0047] The microcontroller 8 performs the process described earlier 
under the control of a computer program stored in RAM/ROM 9, which is 
loaded and executed when handset 1 enters the camera state. It will be 
appreciated that the process may be executed by a dedicated image 
processor, which may itself be included in the camera unit 7. 
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[0048] Referring to Fig. 10, an arrangement of the digital camera 
unit 7, microprocessor 8, RAM/ROM 9 and LCD 4 is shown. 

[0049] The digital camera unit 7 includes a CMOS sensor 24 and an 
analogue-to-digital converter (ADC) 25. The CMOS sensor receives light 26 
and generates a corresponding electrical signal 27 which is converted into 
an image signal 28. The image signal 28 is fed to the microcontroller 8 
which operates display driving software 29 which provides a display 
signal 30 to the display 4. 

[0050] The microcontroller 8 executes first, second and third 
routines 31, 32, 33. The first routine 31 performs the exposure control 
algorithm which encompasses steps S2 to S4 of the process shown in 
Fig. 5. The second routine 32 performs the white balancing algorithm which 
generally covers steps S5 to S7 of the process shown in Fig. 5. The third 
routine 33 performs the dark reference algorithm which is broadly 
encompasses steps S8 to S10. While performing the algorithms, the 
microcontroller 8 exchanges signals 34, 35, 36 with the camera unit 7. For 
example, the first routine 31 receives light levels and sends instructions 
regarding pixel integration time. The second routine 32 receives color 
channel information and sends instructions to adjust gain for each color 
channel. The third routine 33 receives information regarding pixel leakage 
and sends instructions to subtract this from the electrical signal 27. 

[0051] First, second and third algorithm results 37, 38, 39 are sent to 
the register 22. In this example, the register 22 is held in RAM, although it 
could be held in the controller's memory (not shown). 

[0052] The microcontroller 8 executes a fourth routine 40 which checks 
the content of the register 22 as outlined in steps S1 1 to S1 7 of the process 
shown in Figure 5. The fourth routine 40 produces a signal 41 which is fed 
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to the display driver 29 for displaying the indicator 20 appropriate to the 
content of the register 22. 

[0053] It will be appreciated that step S2 to S10 and steps S11 to S17 
need not be executed by the same processor and, in particular by the 
microcontroller 8. For example, steps S2 to S10 may be performed by a 
processor embedded in the camera unit 7. 

[0054] It will be appreciated that many modifications may be made to 
the embodiment described above. For example, the digital camera unit may 
be mounted anywhere on the handset, for example on the front side of the 
handset or connected to the handset via a cable. The image sensor may 
comprise a different type of sensor, such as a charge coupled device (CCD). 

[0055] Rather than determine whether a stable solution has been 
found, other criteria may be used to determine whether an image is ready to 
be captured. These criteria may include numerical thresholds or ranges. 

[0056] Different shapes of indicators may be used such as a circular 
pie-chart. One or more flags may be used and one or more levels can be 
displayed. The number of flags need not equal the number of levels. The 
indicator may comprise multicolored indicator. Thus, for example a green 
shape may signify a picture of optimal quality picture, an amber shape may 
represent a near-optimal quality picture and a red shape may indicate a 
poor-quality picture. The indicator may be multi-shaped. Thus, a tick or 
check may signify an optimal-quality picture. 

[0057] Additionally or alternatively, an audio signal may be provided as 
an indicator of image quality. This may comprise spoken words such as 
"ready" or "not ready", different tunes or tones of varying pitch. 
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